Spotty: Imaging Sonification Based on Spot-mapping and Tonal Volume
نویسنده
چکیده
A basic question at image sonification is the image segmentation. A cognitive model of visual processing in a greater degree could define possible ways of sound mapping. For instance, the scanpath theory suggests that a top-down internal cognitive model, of what we see, drives the sequences of rapid eye movements and fixations or glances that so efficiently travel over scene or picture of interest. The scanpath theory may be applied at sonification of visual image. But it is necessary to solve, what is more important in each stage of the image recognition process: the scan trajectory or the optical characteristics of its extreme positions? That is to say, what is dominant scanpath or the spot of glance? I hope a solution of these questions will allow to develop new tools for VR applications as well as to continue designing of visualization system for blind people on a basis of blind-eye tracking.
منابع مشابه
Sonification of fish movement using pitch mesh pairs
On a traditional keyboard, the actions required to play a consonant chord progression must be quite precise; accidentally strike a neighboring key, and a pleasant sonority is likely to become a jarring one. Inspired by the Tonnetz (a tonal diagram), we present a new layout of pitches defined using low-level harmonic notions. We demonstrate the potential of our system by mapping the random movem...
متن کاملIntuitive and Interactive Movement Sonification on a Heterogeneous RISC / DSP Platform
A major requirement for effective and interactive sonification in rehabilitation is the availability of a mobile platform. Portable state of the art motion capturing is achieved with inertial sensors. This paper presents a real-time, low latency sonification demonstrator based on an low power consumption ARM Cortex A8 processor, which is designed for mobile usage. The sonification demonstrator ...
متن کاملTONAL DisCo: DISSONANCE AND CONSONANCE IN A GAMING ENGINE
Whilst there are several existing toolkits specifically designed for sonification, there has been little investigation into the utilization of computer game engines for sonification. This paper will demonstrate the implementation of a real time game engine for the purpose of sonification and discuss the opportunities and limitations. An important aspect which is lacking in existing sonification...
متن کاملForest Stand Types Classification Using Tree-Based Algorithms and SPOT-HRG Data
Forest types mapping, is one of the most necessary elements in the forest management and silviculture treatments. Traditional methods such as field surveys are almost time-consuming and cost-intensive. Improvements in remote sensing data sources and classification –estimation methods are preparing new opportunities for obtaining more accurate forest biophysical attributes maps. This research co...
متن کاملChemical Spectral Analysis through Sonification
Chemical spectra are an important part of how research chemists analyse the outcomes of experiments. However these complex spectra can be very difficult and time consuming to analyse. This paper outlines an investigation into using sonification to improve the understanding and ease of analysis of chemical spectral data. The project specifically uses sonification techniques to display Nuclear Ma...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2001